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DETAILED ACTION 

Response to Arguments 

1. Applicant's arguments filed 1 1/10/2009 have been fully considered but they are not persuasive. 

2. Re claims 1 and 12, the Applicant contends that the prior art cited fails to teach either providing a 
sequence of camera control parameters derived from first inspection data to take inspection data or that 
the second inspection data result from a sequential series of images of the surface taken in response to 
the control parameters, wherein the images are taken at different camera poses, again, as dictated by the 
control parameters. However, the Examiner respectfully disagrees. Takeyasu discloses that the 
controlling of the inspection apparatus includes the step of revolving a third driving shaft a predetermined 
angle while moving a second driving shaft in response to an output of a proximity sensor so as to hold 
constant a distance between the inspection head and an inner surface of the pipe, thereby to detect a 
positional deviation between the third driving shaft and the center axis of the pipe, and the inspection 
image input step of controlling the revolution angle of the third driving shaft in dependence on the 
positional deviation while moving the second driving shaft in response to the output of the proximity 
sensor, thereby making it possible to pick up inspection images at positions at equal intervals in the 
circumferential direction of the pipe (Takeyasu: column 2, line 60-column 3, line 6). Therefore, in view of 
the disclosure recited above, Takeyasu provides for adjusting the position in response to proximity sensor 
data in order to capture a sequence of images in response to the control data. 

Claim Rejections - 35 USC §102 

3. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for 
the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or 
in public use or on sale in this country, more than one year prior to the date of application for 
patent in the United States. 
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4. Claims 1, 8-10, 12-13, 18-23, 30-37, and 47 are rejected under 35 U.S.C. 102(b) as being 
anticipated by Takeyasu et al. (US 4255762 A, hereinafter referred to as "Takeyasu"). 

Re claim 1 , Takeyasu discloses a method of repeating an inspection of a surface of interest with 
an inspection system including a control unit coupled to a camera, the method comprising acts of: 
providing a sequence of camera control parameters corresponding to first inspection data of the surface 
of interest from the control unit to the camera (Takeyasu: Abstract section, "a control device which is 
capable of programmed operation and which drives and controls the positioning mechanism in a 
predetermined operation sequence programmed in advance"); acquiring at least one second inspection 
data including an inspection sequence of images of the surface of interest according to the sequence of 
camera control parameters (Takeyasu: Abstract section, "the control device controlling the positioning 
mechanism on the basis of an output signal from the proximity sensor, so that the inspection head portion 
can be moved and controlled from an initially-set position outside the pipe towards an inspection position 
of the pipe without contacting with the object to-be-inspected"), the sequence of camera control 
parameters includes a plurality of sets of camera control parameters, each set of camera control 
parameters defining at least one pose of the camera (Takeyasu: column 2, line 60-column 3, line 6); and 
acquiring at least one image from each pose of the camera defined by the plurality of sets of camera 
control parameters (Takeyasu: column 2, line 60-column 3, line 6). 

Re claim 8, Takeyasu discloses an act of mounting the camera at a reference location having a 
known position relative to the surface of interest (Takeyasu: Fig. 1; column 4, lines 4-11, the apparatus is 
mounted in a specific location). 

Re claim 9, Takeyasu discloses that the act of applying the sequence of camera control 
parameters includes an act of applying the sequence of camera control parameters such that each set of 
camera control parameters is an offset from the reference location (Takeyasu: column 1 1 , lines 3-15 and 
38-50, alignment correction based on measured differences between two proximity sensors). 
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Re claim 10, Takeyasu discloses that the act of applying the sequence of camera control 
parameters includes an act of applying the sequence of camera control parameters such that each set of 
camera control parameters is an offset from an immediately preceding pose of the camera (Takeyasu: 
column 11, lines 26-37, position correction performed using feedback from previously measured proximity 
readings). 

Re claim 12, Takeyasu discloses an inspection apparatus adapted to automatically acquire 
inspection data of a surface of interest, the apparatus comprising: data collection equipment including a 
camera capable of acquiring at least one image of the surface of interest (Takeyasu: column 4, lines 49- 
54); and a control unit coupled to the data collection equipment, the control unit configured to provide a 
sequence of camera control parameters corresponding to first inspection data of the surface of interest to 
the camera to acquire at least one second inspection data of the surface of interest (Takeyasu: column 7, 
lines 15-27), the at least one second inspection data includes an inspection sequence of images of the 
surface of interest, wherein the sequence of camera control parameters includes a plurality of sets of 
camera control parameters, each set of camera control parameters defining a pose of the camera such 
that the inspection sequence of images includes at least one image acquired from each pose defined by 
the plurality of sets of camera control parameters (Takeyasu: column 2, line 60-column 3, line 6). 

Re claim 13, Takeyasu discloses that the sequence of camera control parameters result at least 
in part from acquiring a first sequence of images of the surface of interest (Takeyasu: Abstract section, 
"the control device controlling the positioning mechanism on the basis of an output signal from the 
proximity sensor, so that the inspection head portion can be moved and controlled from an initially-set 
position outside the pipe towards an inspection position of the pipe without contacting with the object to- 
be-inspected"; column 11, lines 51-57, "abnormality processing routine" indicates adaptive control based 
on previously sensed data). 

Re claim 18, Takeyasu discloses that the camera is a video camera (Takeyasu: column 4, lines 

49-54). 
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Re claim 19, Takeyasu discloses that the video camera has at least two degrees of freedom 
(Takeyasu: Fig. 2, the figure shows both linear movement and rotational movement along each of the x, 
y, and z axes, thus indicating six degrees of freedom). 

Re claim 20, Takeyasu discloses that the video camera has at least four degrees of freedom 
(Takeyasu: Fig. 2, the figure shows both linear movement and rotational movement along each of the x, 
y, and z axes, thus indicating six degrees of freedom). 

Re claim 21, Takeyasu discloses that the video camera has at least six degrees of freedom 
(Takeyasu: Fig. 2, the figure shows both linear movement and rotational movement along each of the x, 
y, and z axes, thus indicating six degrees of freedom). 

Re claim 22, Takeyasu discloses that the control unit comprises a computer having a memory for 
storing at least one sequence of camera control parameters (Takeyasu: column 7, lines 15-20, ROM for 
storing programs). 

Re claim 23, Takeyasu discloses that the memory is encoded with at least one program 
configured to automatically analyze the inspection sequence of images to detect the presence or absence 
of subject matter of interest in each image in the sequence (Takeyasu: column 7, lines 15-20, control 
programs stored in ROM). 

Re claim 30, Takeyasu discloses the inspection apparatus of claim 18, in combination with the 
surface of interest (Takeyasu: Abstract section, the disclosure includes an object to be inspected). 

Re claim 31 , Takeyasu discloses that the surface of interest is an inside surface of a substantially 
closed volume (Takeyasu: Abstract section, inner surface of a pipe being an object to be inspected). 

Re claim 32, Takeyasu discloses that the surface of interest is a tank (Takeyasu: Fig. 1; column 
4, lines 4-1 1 , shows a nuclear reactor, which is analogous to a tank since it is an enclosed chamber). 
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Re claim 33, Takeyasu discloses that access to the inside of the volume is permitted through at 
least one entry point (Takeyasu: Fig. 1 and column 4, lines 4-11). 

Re claim 34, Takeyasu discloses that the data collection equipment further includes a stalk 
having the video camera coupled to a first end of the stalk, the stalk comprising: means for securing the 
stalk to the at least one entry point, such that the first end of the stalk is inside the volume (Takeyasu: Fig. 
1, traverse machine 6; column 12-15). 

Re claim 35, Takeyasu discloses means for positioning the camera in a known reference position 
with respect to the volume (Takeyasu: Fig. 4(a), servomotor 42). 

Re claim 36, Takeyasu discloses that the data collection equipment is adapted to be submersed 
in a fluid (Takeyasu: column 1, lines 16-18, inspection of a liquid storage tank). 

Re claim 37, Takeyasu discloses that the data collection equipment includes locomotion means 
adapted to navigate the data collection equipment through the fluid (Takeyasu: Fig. 4(a), servomotor 42; 
Fig. 2, movement along x, y, and z axes). 

Re claim 47, Takeyasu discloses that the means for automatically acquiring at least one 
sequence comprises: a video camera (Takeyasu: column 4, lines 49-54); a processor coupled to the 
video camera via communications means (Takeyasu: Fig. 4(b), microprocessor 71); and a memory 
accessible by the processor having stored thereon the sequence of camera control parameters 
associated with each pose of the camera that when applied to the camera by the processor results in the 
sequence of images (Takeyasu: column 7, lines 15-20, control programs stored in ROM). 

Claim Rejections - 35 USC §103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 

rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as 
set forth in section 1 02 of this title, if the differences between the subject matter sought to be 
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patented and the prior art are such that the subject matter as a whole would have been obvious 
at the time the invention was made to a person having ordinary skill in the art to which said 
subject matter pertains. Patentability shall not be negatived by the manner in which the invention 
was made. 

6. Claims 2-3, 7, 11, 14, 17, and 26-29 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Takeyasu et al. (US 4255762 A) in view of Marx (US 4974168 A). 

Re claim 2, Takeyasu discloses a majority of the features of claim 2, as discussed above in claim 
1 , but Takeyasu does not specifically disclose that the act of providing the sequence of camera control 
parameters includes an act of providing a sequence of camera control parameters having resulted at 
least in part from manually acquiring a first sequence of images of the surface of interest. However, Marx 
discloses an automatic pipeline data collection and display system, wherein the capability exists for the 
operator to manually initialize footage and time function data (Marx: column 1 1 , lines 52-53) and the 
operator may issue a command for the control program to commence (Marx: column 10, lines 61-64). 
Since both Takeyasu and Marx relate to performing inspections of enclosed areas, one of ordinary skill in 
the art at the time of the invention would have found it obvious to combine the manual operation 
capabilities of Marx with the inspection system of Takeyasu in order to provide a system with increased 
stability of data storage, improved display of data without reduction in video image quality, and enhanced 
ability to monitor and display additional functions (Marx: column 2, lines 10-14). 

Re claim 3, Takeyasu discloses a majority of the features of claim 3, as discussed above in claim 
1 , but Takeyasu does not specifically disclose that the act of providing the sequence of camera control 
parameters includes an act of providing a sequence of camera control parameters having resulted at 
least in part from operator programming. However, Marx discloses an automatic pipeline data collection 
and display system, wherein the capability exists for the operator to manually initialize footage and time 
function data (Marx: column 1 1 , lines 52-53) and the operator may issue a command for the control 
program to commence (Marx: column 10, lines 61-64). Since both Takeyasu and Marx relate to 
performing inspections of enclosed areas, one of ordinary skill in the art at the time of the invention would 
have found it obvious to combine the manual operation capabilities of Marx with the inspection system of 
Takeyasu in order to provide a system with increased stability of data storage, improved display of data 
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without reduction in video image quality, and enhanced ability to monitor and display additional functions 
(Marx: column 2, lines 10-14). 

Re claim 7, Takeyasu does not explicitly disclose that each set of camera control parameters 
includes a value related to at least one of a pan action, a tilt action, a zoom and a position. However, 
Marx discloses that the camera position sensor may tilt the camera (Marx: column 5, lines 38-41). Since 
both Takeyasu and Marx relate to performing inspections of enclosed areas, one of ordinary skill in the art 
at the time of the invention would have found it obvious to combine the information correlation of Marx 
with the inspection system of Takeyasu in order to provide a system with increased stability of data 
storage, improved display of data without reduction in video image quality, and enhanced ability to 
monitor and display additional functions (Marx: column 2, lines 7-14). 

Re claim 1 1 , Takeyasu discloses a majority of the features of claim 1 1 , as discussed above in 
claim 1 , but does not specifically disclose an act of obtaining the sequence of camera control parameters 
from a computer readable medium. However, Marx discloses that the system provides program update 
capabilities via linkage of the CPU to an external device such as a disk drive (Marx: column 9, lines 34- 
41). Since both Takeyasu and Marx relate to performing inspections of enclosed areas, one of ordinary 
skill in the art at the time of the invention would have found it obvious to combine the update capabilities 
of Marx with the inspection system of Takeyasu in order to provide a system with increased stability of 
data storage, improved display of data without reduction in video image quality, and enhanced ability to 
monitor and display additional functions (Marx: column 2, lines 10-14). 

Re claim 14, arguments analogous to those presented for claim 3 above are applicable to claim 
14. Therefore, claim 14 has been analyzed and rejected with respect to claim 3 above. 

Re claim 17, arguments analogous to those presented for claim 7 above are applicable to claim 
17. Therefore, claim 17 has been analyzed and rejected with respect to claim 7 above. 

Re claim 26, Takeyasu does not explicitly disclose a video recorder coupled to the video camera 
and the computer, the video recorder adapted to receive video data from the video camera and to provide 
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image information based on the video data to the computer. However, Marx discloses that a video hard 
copy is stored (Marx: Fig. 3, hard copy 65; column 4, lines 65-67). Since both Takeyasu and Marx relate 
to performing inspections of enclosed areas, one of ordinary skill in the art at the time of the invention 
would have found it obvious to combine the storage capability of Marx with the inspection system of 
Takeyasu in order to provide a system with increased stability of data storage, improved display of data 
without reduction in video image quality, and enhanced ability to monitor and display additional functions 
(Marx: column 2, lines 7-14). 

Re claim 27, Takeyasu discloses that when the inspection system is operating on the sequence 
of camera control parameters the video data includes an inspection sequence of images of the surface of 
interest and the image information includes a digital inspection sequence of images of the surface of 
interest (Takeyasu: column 1 1 , lines 51-57, adaptive control performed in conjunction with sensors). 

Re claim 28, Takeyasu discloses a display coupled to the video recorder for displaying the video 
data received from the video camera (Takeyasu: column 4, lines 49-54). 

Re claim 29, Takeyasu does not explicitly disclose an interface device adapted to be controlled 
by an operator and to provide control signals indicative of operator control. However, Marx discloses a 
keyboard for use by an operator (Marx: Fig. 3, keyboard comments 51; Fig. 8). Since both Takeyasu and 
Marx relate to performing inspections of enclosed areas, one of ordinary skill in the art at the time of the 
invention would have found it obvious to combine the manual operation capabilities of Marx with the 
inspection system of Takeyasu in order to provide a system with increased stability of data storage, 
improved display of data without reduction in video image quality, and enhanced ability to monitor and 
display additional functions (Marx: column 2, lines 10-14). 



7. Claims 24-25 and 41-45 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Takeyasu et al. (US 4255762 A) in view of Ng et al. (US 7460691 B2). 



Application/Control Number: 10/508,850 Page 10 

Art Unit: 2621 

Re claim 24, Takeyasu discloses a majority of the features of claim 24, as discussed above in 
claim 22, but Takeyasu does not specifically disclose that the at least one program automatically 
analyzes the inspection sequence of images by distinguishing subject matter of interest from the image 
content by at least one of color analysis, edge analysis and shape analysis. However, Ng discloses a 
system for image processing, wherein edge density information of an input image is processed to 
distinguish between complex texture of a region of interest and homogeneous texture of the background 
(Ng: column 9, lines 50-54). Since both Takeyasu and Ng relate to monitoring a defined region to detect 
abnormalities, one of ordinary skill in the art at the time of the invention would have found it obvious to 
combine the image processing principles of Ng with the system of Takeyasu in order to eliminate the 
need for reference image comparison (Ng: column 9, lines 54-58). 

Re claim 25, Takeyasu does not specifically disclose that the at least one program provides an 
inspection result of the surface of interest. However, Ng discloses that an input video image may be 
processed whereby the presence of a specific object in the region of interest is determined (Ng: column 1 , 
lines 50-53). Since both Takeyasu and Ng relate to monitoring a defined region to detect abnormalities, 
one of ordinary skill in the art at the time of the invention would have found it obvious to combine the 
image processing principles of Ng with the system of Takeyasu in order to eliminate the need for 
reference image comparison (Ng: column 9, lines 54-58). 

Re claim 41 , Takeyasu discloses a majority of the features of claim 41 , as discussed above in 
claim 38, but Takeyasu does not specifically disclose that automatically determining the amount of 
subject matter of interest present in the sequence of images. However, Ng discloses that gray level pixel 
intensity is used to determine average intensity and variance with respect to the number of pixels in a 
region of interest (Ng: column 9, lines 3-24 and equations (1 ) and (2)), thereby indicating that the amount 
of subject matter of interest is determined. Since both Takeyasu and Ng relate to monitoring a defined 
region to detect abnormalities, one of ordinary skill in the art at the time of the invention would have found 
it obvious to combine the image processing principles of Ng with the system of Takeyasu in order to 
eliminate the need for reference image comparison (Ng: column 9, lines 54-58). 
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Re claim 42, Takeyasu does not specifically disclose that the act of automatically determining the 
amount of subject matter of interest includes an act of automatically detecting characteristic features of 
the subject matter of interest. However, Ng discloses that the pixel intensity values for a region of interest 
are determined (Ng: column 9, lines 3-24 and equations (1) and (2)). Since both Takeyasu and Ng relate 
to monitoring a defined region to detect abnormalities, one of ordinary skill in the art at the time of the 
invention would have found it obvious to combine the image processing principles of Ng with the system 
of Takeyasu in order to eliminate the need for reference image comparison (Ng: column 9, lines 54-58). 

Re claim 43, Takeyasu does not specifically disclose that the act of automatically detecting 
characteristic features of the subject matter of interest includes an act of automatically detecting edge 
characteristics of the subject matter of interest. However, Ng discloses that edge density information of 
an input image is processed to distinguish between complex texture of a region of interest and 
homogeneous texture of the background (Ng: column 9, lines 50-54). Since both Takeyasu and Ng relate 
to monitoring a defined region to detect abnormalities, one of ordinary skill in the art at the time of the 
invention would have found it obvious to combine the image processing principles of Ng with the system 
of Takeyasu in order to eliminate the need for reference image comparison (Ng: column 9, lines 54-58). 

Re claim 44, Takeyasu does not specifically disclosethat the act of automatically detecting edge 
characteristics includes an act of automatically detecting edge characteristics based on at least one of 
edge strength, edge cluster size, and edge cluster eccentricity. However, Ng discloses that gray level 
pixel intensity is used to determine average intensity and variance with respect to the number of pixels in 
a region of interest (Ng: column 9, lines 3-24 and equations (1) and (2)), thereby indicating that the size of 
the region of interest is determined. Since both Takeyasu and Ng relate to monitoring a defined region to 
detect abnormalities, one of ordinary skill in the art at the time of the invention would have found it 
obvious to combine the image processing principles of Ng with the system of Takeyasu in order to 
eliminate the need for reference image comparison (Ng: column 9, lines 54-58). 

Re claim 45, Takeyasu does not specifically disclose that the act of automatically detecting edge 
characteristics includes an act of evaluating an edge cluster based on at least one of the mean greyscale 



Application/Control Number: 10/508,850 Page 12 

Art Unit: 2621 

value of the edge cluster and the standard deviation of the greyscale values of the edge cluster. 
However, Ng discloses that gray level pixel intensity is used to determine average intensity and variance 
with respect to the number of pixels in a region of interest (Ng: column 9, lines 3-24 and equations (1 ) and 
(2)). Since both Takeyasu and Ng relate to monitoring a defined region to detect abnormalities, one of 
ordinary skill in the art at the time of the invention would have found it obvious to combine the image 
processing principles of Ng with the system of Takeyasu in order to eliminate the need for reference 
image comparison (Ng: column 9, lines 54-58). 

Conclusion 

8. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time policy as set forth 
in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE MONTHS from 
the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date 
of this final action and the advisory action is not mailed until after the end of the THREE-MONTH 
shortened statutory period, then the shortened statutory period will expire on the date the advisory action 
is mailed, and any extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later than SIX 
MONTHS from the mailing date of this final action. 

Contact 

Any inquiry concerning this communication or earlier communications from the examiner should 
be directed to CHRISTOPHER FINDLEY whose telephone number is (571)270-1199. The examiner can 
normally be reached on Monday-Friday (8:30 AM-5:00 PM). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, 
Marsha D. Banks-Harold can be reached on 571-272-7905. The fax phone number for the organization 
where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent Application 
Information Retrieval (PAIR) system. Status information for published applications may be obtained from 
either Private PAIR or Public PAIR. Status information for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic Business Center (EBC) 
at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative 
or access to the automated information system, call 800-786-9199 (IN USA OR CANADA) or 571-272- 
1000. 
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